Examining social reinforcement learning in social anxiety.

BACKGROUND AND OBJECTIVES: Reinforcement learning biases have been empirically linked to anhedonia in depression and theoretically linked to social anhedonia in social anxiety disorder, but little work has directly assessed how socially anxious individuals learn from social reward and punishment. METHODS: N = 157 individuals high and low in social anxiety symptoms completed a social probabilistic selection task that involved selecting between pairs of neutral faces with varying probabilities of changing to a happy or angry face. Computational modeling was performed to estimate learning rates. Accuracy in choosing the more rewarding face was also analyzed. RESULTS: No significant group differences were found for learning rates. Contrary to hypotheses, participants high in social anxiety showed impaired punishment learning accuracy; they were more accurate at choosing the most rewarding face than they were at avoiding the most punishing face, and their punishment learning accuracy was lower than that of participants low in social anxiety. Secondary analyses found that high (vs. low) social anxiety participants were less accurate at selecting the more rewarding face on more (vs. less) punishing face pairs. LIMITATIONS: Stimuli were static, White, facial images, which lack important social cues (e.g., movement, sound) and diversity, and participants were largely non-Hispanic, White undergraduates, whose social reinforcement learning may differ from individuals at different developmental stages and those holding more marginalized identities. CONCLUSIONS: Socially anxious individuals may be less accurate at learning to avoid social punishment, which may maintain negative beliefs through an interpersonal stress generation process.

Developmental Changes in Habenular and Striatal Social Reinforcement Responsivity Across Adolescence Linked With Substance Use.

BACKGROUND: Habenula (HB) function is implicated in substance use disorders and is involved in inhibiting dopamine release in the ventral striatum (VS). While blunted VS reward responsivity is implicated in risk for later substance use, links between HB reinforcement processing and progression of use have not, to our knowledge, been examined among adolescents. In the present study, we longitudinally assessed HB and VS responsivity to social rewards and punishments across adolescence and examined associations with substance use. METHODS: Within a longitudinal design, 170 adolescents (53.5% female) completed 1 to 3 functional magnetic resonance imaging scans across 6th to 9th grade and reported yearly substance use across 6th to 11th grade. We examined VS and HB responsivity to social reinforcement during a social incentive delay task in which adolescents received social rewards (smiling faces) and punishments (scowling faces). RESULTS: We observed increased VS responsivity to social rewards (vs. reward omissions) and increased VS, but decreased HB, responsivity to social punishment avoidance versus receipt. However, contrary to hypotheses, the HB displayed increased responsivity to social rewards (vs. reward omissions). Further, adolescents reporting regular substance use displayed longitudinally declining HB responsivity to social rewards (vs. reward omissions), whereas adolescents reporting no substance use displayed longitudinally increasing HB responsivity. In contrast, whereas VS responsivity to punishment avoidance versus receipt increased longitudinally among regular substance users, it stayed relatively stable among nonusers. CONCLUSIONS: These results suggest that differential HB and VS social reinforcement processing trajectories across adolescence are associated with substance use.

Modeling time evolving COVID-19 uncertainties with density dependent asymptomatic infections and social reinforcement.

The COVID-19 pandemic has posed significant challenges in modeling its complex epidemic transmissions, infection and contagion, which are very different from known epidemics. The challenges in quantifying COVID-19 complexities include effectively modeling its process and data uncertainties. The uncertainties are embedded in implicit and high-proportional undocumented infections, asymptomatic contagion, social reinforcement of infections, and various quality issues in the reported data. These uncertainties become even more apparent in the first 2 months of the COVID-19 pandemic, when the relevant knowledge, case reporting and testing were all limited. Here we introduce a novel hybrid approach SUDR by expanding the foundational compartmental epidemic Susceptible-Infected-Recovered (SIR) model with two compartments to a Susceptible-Undocumented infected-Documented infected-Recovered (SUDR) model. First, SUDR (1) characterizes and distinguishes Undocumented (U) and Documented (D) infections commonly seen during COVID-19 incubation periods and asymptomatic infections. Second, SUDR characterizes the probabilistic density of infections by capturing exogenous processes like clustering contagion interactions, superspreading, and social reinforcement. Lastly, SUDR approximates the density likelihood of COVID-19 prevalence over time by incorporating Bayesian inference into SUDR. Different from existing COVID-19 models, SUDR characterizes the undocumented infections during unknown transmission processes. To capture the uncertainties of temporal transmission and social reinforcement during COVID-19 contagion, the transmission rate is modeled by a time-varying density function of undocumented infectious cases. By sampling from the mean-field posterior distribution with reasonable priors, SUDR handles the randomness, noise and sparsity of COVID-19 observations widely seen in the public COVID-19 case data. The results demonstrate a deeper quantitative understanding of the above uncertainties, in comparison with classic SIR, time-dependent SIR, and probabilistic SIR models.

Social reinforcement learning as a predictor of real-life experiences in individuals with high and low depressive symptomatology.

BACKGROUND: Several studies have reported diminished learning from non-social outcomes in depressed individuals. However, it is not clear how depression impacts learning from social feedback. Notably, mood disorders are commonly associated with deficits in social functioning, which raises the possibility that potential impairments in social learning may negatively affect real-life social experiences in depressed subjects. METHODS: Ninety-two participants with high (HD; N = 40) and low (LD; N = 52) depression scores were recruited. Subjects performed a learning task, during which they received monetary outcomes or social feedback which they were told came from other people. Additionally, participants answered questions about their everyday social experiences. Computational models were fit to the data and model parameters were related to social experience measures. RESULTS: HD subjects reported a reduced quality and quantity of social experiences compared to LD controls, including an increase in the amount of time spent in negative social situations. Moreover, HD participants showed lower learning rates than LD subjects in the social condition of the task. Interestingly, across all participants, reduced social learning rates predicted higher amounts of time spent in negative social situations, even when depression scores were controlled for. CONCLUSION: These findings indicate that deficits in social learning may affect the quality of everyday social experiences. Specifically, the impaired ability to use social feedback to appropriately update future actions, which was observed in HD subjects, may lead to suboptimal interpersonal behavior in real life. This, in turn, may evoke negative feedback from others, thus bringing about more unpleasant social encounters.

Methamphetamine and social rewards interact to produce enhanced conditioned place preference in male adolescent rats.

Elucidating the influence of social context on drug reward is critical for understanding substance use disorders. Adolescents demonstrate enhanced sensitivity to drug and social rewards. However, the extent to which methamphetamine interacts with social reward in adolescents has not been thoroughly examined. Therefore, the present study used the conditioned place preference (CPP) model to examine the relationship between methamphetamine and social rewards in adolescent male rats. Sprague-Dawley rats (PND 30) were randomly assigned to one of the following four conditioning groups: saline alone (SA), methamphetamine alone (MA), saline with a social partner (SS) or methamphetamine with a social partner (MS). Testing occurred in a two-chamber biased apparatus across seven consecutive days using parameters presumed to be sub-threshold for establishing social- and methamphetamine-induced CPP. Similar to previous reports for nicotine and cocaine, the present results indicate that rats receiving methamphetamine with a social partner (i.e., MS) during conditioning demonstrated a significantly greater preference shift compared to all other groups. These findings further highlight the importance of social context in influencing the magnitude of drug reward during adolescence.

The actions of others act as a pseudo-reward to drive imitation in the context of social reinforcement learning.

While there is no doubt that social signals affect human reinforcement learning, there is still no consensus about how this process is computationally implemented. To address this issue, we compared three psychologically plausible hypotheses about the algorithmic implementation of imitation in reinforcement learning. The first hypothesis, decision biasing (DB), postulates that imitation consists in transiently biasing the learner's action selection without affecting their value function. According to the second hypothesis, model-based imitation (MB), the learner infers the demonstrator's value function through inverse reinforcement learning and uses it to bias action selection. Finally, according to the third hypothesis, value shaping (VS), the demonstrator's actions directly affect the learner's value function. We tested these three hypotheses in 2 experiments (N = 24 and N = 44) featuring a new variant of a social reinforcement learning task. We show through model comparison and model simulation that VS provides the best explanation of learner's behavior. Results replicated in a third independent experiment featuring a larger cohort and a different design (N = 302). In our experiments, we also manipulated the quality of the demonstrators' choices and found that learners were able to adapt their imitation rate, so that only skilled demonstrators were imitated. We proposed and tested an efficient meta-learning process to account for this effect, where imitation is regulated by the agreement between the learner and the demonstrator. In sum, our findings provide new insights and perspectives on the computational mechanisms underlying adaptive imitation in human reinforcement learning.

Modeling the formation of social conventions from embodied real-time interactions.

What is the role of real-time control and learning in the formation of social conventions? To answer this question, we propose a computational model that matches human behavioral data in a social decision-making game that was analyzed both in discrete-time and continuous-time setups. Furthermore, unlike previous approaches, our model takes into account the role of sensorimotor control loops in embodied decision-making scenarios. For this purpose, we introduce the Control-based Reinforcement Learning (CRL) model. CRL is grounded in the Distributed Adaptive Control (DAC) theory of mind and brain, where low-level sensorimotor control is modulated through perceptual and behavioral learning in a layered structure. CRL follows these principles by implementing a feedback control loop handling the agent's reactive behaviors (pre-wired reflexes), along with an Adaptive Layer that uses reinforcement learning to maximize long-term reward. We test our model in a multi-agent game-theoretic task in which coordination must be achieved to find an optimal solution. We show that CRL is able to reach human-level performance on standard game-theoretic metrics such as efficiency in acquiring rewards and fairness in reward distribution.

Incorporating discriminative stimuli into functional communication training with augmentative and alternative communication devices: a tutorial.

Functional communication training (FCT) is a commonly used and effective treatment for problem behavior maintained by social reinforcement (e.g., an individual engages in self-injurious behavior to gain access to adult attention). FCT involves teaching an individual to emit an appropriate communication response to access the reinforcer maintaining problem behavior (e.g., pressing a "Play, please" symbol on a device to gain the communication partner's attention) and withholding that reinforcer following problem behavior (e.g., the communication partner minimizes attention-following problem behavior and waits for a communication response). Techniques such as incorporating discriminative stimuli (e.g., differently colored cards) can make FCT more practical for caregivers by teaching individuals when reinforcement is and is not available for communication responses while simultaneously mitigating treatment relapse. Despite the effectiveness of FCT with discriminative stimuli, no studies have leveraged the capabilities of augmentative and alternative communication (AAC) devices by embedding discriminative stimuli within AAC software (e.g., by coloring communication symbols or grids). Our tutorial provides a comprehensive overview of how practitioners can incorporate FCT with discriminative stimuli into practice and includes video models of how to design these treatments on two common AAC apps.

The role of mainstreamness and interdisciplinarity for the relevance of scientific papers.

Is it possible to tell how interdisciplinary and out-of-the-box scientific papers are, or which papers are mainstream? Here we use the bibliographic coupling network, derived from all physics papers that were published in the Physical Review journals in the past century, to try to identify them as mainstream, out-of-the-box, or interdisciplinary. We show that the network clusters into scientific fields. The position of individual papers with respect to these clusters allows us to estimate their degree of mainstreamness or interdisciplinarity. We show that over the past decades the fraction of mainstream papers increases, the fraction of out-of-the-box decreases, and the fraction of interdisciplinary papers remains constant. Studying the rewards of papers, we find that in terms of absolute citations, both, mainstream and interdisciplinary papers are rewarded. In the long run, mainstream papers perform less than interdisciplinary ones in terms of citation rates. We conclude that to avoid a unilateral trend towards mainstreamness a new incentive scheme is necessary.

Auditory learning in an operant task with social reinforcement is dependent on neuroestrogen synthesis in the male songbird auditory cortex.

Animals continually assess their environment for cues associated with threats, competitors, allies, mates or prey, and experience is crucial for those associations. The auditory cortex is important for these computations to enable valence assignment and associative learning. The caudomedial nidopallium (NCM) is part of the songbird auditory association cortex and it is implicated in juvenile song learning, song memorization, and song perception. Like human auditory cortex, NCM is a site of action of estradiol (E2) and is enriched with the enzyme aromatase (E2-synthase). However, it is unclear how E2 modulates auditory learning and perception in the vertebrate auditory cortex. In this study we employ a novel, auditory-dependent operant task governed by social reinforcement to test the hypothesis that neuro-E2 synthesis supports auditory learning in adult male zebra finches. We show that local suppression of aromatase activity in NCM disrupts auditory association learning. By contrast, post-learning performance is unaffected by either NCM aromatase blockade or NCM pharmacological inactivation, suggesting that NCM E2 production and even NCM itself are not required for post-learning auditory discrimination or memory retrieval. Therefore, neuroestrogen synthesis in auditory cortex supports the association between sounds and behaviorally relevant consequences.

Victory is its own reward: oxytocin increases costly competitive behavior in schizophrenia.

BACKGROUND: Aberrant sensitivity to social reward may be an important contributor to abnormal social behavior that is a core feature of schizophrenia. The neuropeptide oxytocin impacts the salience of social information across species, but its effect on social reward in schizophrenia is unknown. METHODS: We used a competitive economic game and computational modeling to examine behavioral dynamics and oxytocin effects on sensitivity to social reward among 39 men with schizophrenia and 54 matched healthy controls. In a randomized, double-blind study, participants received one dose of oxytocin (40 IU) or placebo and completed a 35-trial Auction Game that quantifies preferences for monetary v. social reward. We analyzed bidding behavior using multilevel linear mixed models and reinforcement learning models. RESULTS: Bidding was motivated by preferences for both monetary and social reward in both groups, but bidding dynamics differed: patients initially overbid less compared to controls, and across trials, controls decreased their bids while patients did not. Oxytocin administration was associated with sustained overbidding across trials, particularly in patients. This drug effect was driven by a stronger preference for winning the auction, regardless of monetary consequences. Learning rate and response variability did not differ between groups or drug condition, suggesting that differences in bidding derive primarily from differences in the subjective value of social rewards. CONCLUSIONS: Our findings suggest that schizophrenia is associated with diminished motivation for social reward that may be increased by oxytocin administration.

Evaluation of adding the community reinforcement approach to motivational enhancement therapy for adults aged 60 years and older with DSM-5 alcohol use disorder: a randomized controlled trial.

AIM: To examine whether adding the Community Reinforcement Approach for Seniors (CRA-S) to Motivational Enhancement Therapy (MET) increases the probability of treatment success in people aged ≥ 60 years with alcohol use disorder (AUD). DESIGN: A single blind multi-centre multi-national randomized (1 : 1) controlled trial. SETTING: Out-patient settings (municipal alcohol treatment clinics in Denmark, specialized addiction care facilities in Germany and a primary care clinic in the United States). PARTICIPANTS: Between January 2014 and May 2016, 693 patients aged 60+ years and fulfilling DSM-5 criteria for AUD participated in comparing MET (n = 351) and MET + CRA-S (n = 342). INTERVENTION AND COMPARATOR: MET (comparator) included four manualized sessions aimed at increasing motivation to change and establishing a change plan. CRA-S (intervention) consisted of up to eight further optional, manualized sessions aimed at helping patients to implement their change plan. CRA-S included a specially designed module on coping with age and age-related problems. MEASUREMENTS: The primary outcome was either total alcohol abstinence or an expected blood alcohol concentration of ≤ 0.05% during the 30 days preceding the 26 weeks follow-up (defined as success) or blood alcohol concentration of > 0.05% during the follow-up period (defined as failure). This was assessed by self-report using the Form 90 instrument. The main analysis involved complete cases. FINDINGS: The follow-up rate at 26 weeks was 76.2% (76.9% in the MET group and 76.0% in the MET + CRA-S group). The success rate in the MET group was 48.9% [95% confidence interval (CI) = 42.9-54.9%] versus 52.3% (95% CI = 46.2-58.3%) in the MET + CRA-S group. The odds of success in the two conditions did not differ (odds ratio = 1.22. 95% CI = 0.86-1.75, P = 0.26, Bayes factor = 0.10). Sensitivity analyses involving alternative approaches to missing values did not change the results. CONCLUSIONS: In older adults with an alcohol use disorder diagnosis, adding the 'community reinforcement approach for seniors' intervention to brief out-patient motivational enhancement therapy treatment did not improve drinking outcome.

Factors affecting the spread of multiple information in social networks.

Information spreading in social networks is affected by many factors. Based on a novel information spreading model with five spreading mechanisms, we analyzed and compared the influence of various factors on information spreading. Through a large number of simulation experiments, we found that: (1) K-shell layers have the greatest impact on information spreading; (2) distance between the two information sources, correlation coefficient between two types of information and social reinforcement also affect the information spreading. The analysis results of these factors will be helpful for us to predict the trend of information spreading and find effective strategies to control information spreading.

Social incentives for adherence to tuberculosis treatment / Incentivos sociales en la adhesión al tratamiento de la tuberculosis / Incentivos sociais na adesão ao tratamento da tuberculose

ABSTRACT Objective: To analyze the influence of social incentives for adherence to tuberculosis (TB) treatment. Method: Qualitative study, in which 26 primary health care professionals of São Paulo were interviewed in 2015.Their testimonies were submitted to the speech analysis technique. The theoretical reference was the social determination of the health-disease process. Ethical procedures were observed. Results: TB is related to precarious living conditions. Incentives such as the basic food basket and transportation stipends are relevant for patients' adherence to treatment, as well as to the create bonds between the patient and the health team. Final considerations: The incentives strengthened adherence to TB treatment. However, interventions in the context of public measures must transcend the remedial dimension and be guided towards the transformation of the TB situation, which means supporting processes that modify living conditions.

RESUMEN Objetivo: Analizar la influencia de los incentivos sociales en la adhesión al tratamiento de la tuberculosis (TB). Método: Estudio cualitativo, en el que 26 profesionales de la Atención Primaria a la Salud del municipio de São Paulo fueron entrevistados en 2015, y sus testimonios fueron sometidos a la técnica de análisis de discurso. El referencial teórico fue la determinación social del proceso salud-enfermedad. Se han resguardado los procedimientos éticos. Resultados: La TB se relaciona con las condiciones precarias de la vida, siendo que los incentivos como la canasta básica y la ayuda para el transporte son relevantes para la adhesión del paciente al tratamiento, así como para el vínculo entre el paciente y el equipo de salud. Consideraciones finales: Los incentivos fortalecen la adhesión al tratamiento de la TB. Sin embargo, las intervenciones en el marco de medidas públicas deben trascender la dimensión paliativa y orientarse para transformar la situación de la TB, lo que significa apoyar procesos que modifiquen las condiciones de vida.

RESUMO Objetivo: Analisar a influência de incentivos sociais na adesão ao tratamento da tuberculose (TB). Método: Estudo qualitativo, em que 26 profissionais da Atenção Primária à Saúde do município de São Paulo foram entrevistados em 2015, e seus depoimentos foram submetidos à técnica de análise de discurso. O referencial teórico foi a determinação social do processo saúde-doença. Os procedimentos éticos foram resguardados. Resultados: A TB está relacionada às condições precárias de vida, sendo que incentivos como a cesta básica e o vale-transporte são relevantes para a adesão do paciente ao tratamento, assim como para o vínculo entre o paciente e a equipe de saúde. Considerações finais: Os incentivos fortalecem a adesão ao tratamento da TB. Contudo, intervenções no âmbito de medidas públicas devem transcender a dimensão paliativa e orientarem-se para transformar a situação da TB, o que significa apoiar processos que modifiquem as condições de vida.

Social representations of HIV/AIDS by older people and the interface with prevention / Representaciones sociales del VIH/SIDA de ancianos y la interrelación con la prevención / Representações sociais do HIV/Aids por idosos e a interface com a prevenção

ABSTRACT Objective: To apprehend the social representations elaborated by older people about HIV/AIDS and to understand how they relate to the prevention of HIV infection. Method: Descriptive and qualitative research based on the Theory of Social Representations with 42 older people assisted at primary care. Data were produced through in-depth interviews with a semi-structured instrument, processed in the IRaMuTeQ software, and analyzed by means of the descending hierarchical classification. Results: Five classes emerged: "HIV/AIDS: a problem of young people"; "Quality of life improvement for people living with HIV/AIDS"; "Vulnerability to HIV/AIDS among heterosexual women in a stable union"; "HIV/AIDS Information Network: process of creation and transformation of social representations" and "Prevention versus stigma". Final considerations: The social representations that older people have about HIV/AIDS influence the adoption of preventive measures negatively because stigma is present and HIV/AIDS is attributed to young men, and to men who have sex with other men.

RESUMEN Objetivo: Comprender las Representaciones Sociales elaboradas por ancianos sobre el VIH/SIDA y entender cómo se relacionan con la infección por VIH. Método: Investigación descriptiva, cualitativa, fundamentada en la Teoría de las Representaciones Sociales, con 42 ancianos atendidos en atención primaria. Datos recolectados mediante entrevistas en profundidad aplicando instrumento semiestructurado, procesados en software IRaMuTeQ y analizados por Clasificación Jerárquica Descendente. Resultados: Surgieron cinco clases: "VIH/SIDA: un problema de jóvenes"; "Mejora de calidad de vida de personas que viven con VIH/SIDA"; "Vulnerabilidad al VIH/SIDA de mujeres heterosexuales en pareja estable"; "Red de informaciones sobre VIH/SIDA: Proceso de creación y transformación de las Representaciones Sociales"; y "Prevención versus Estigma". Consideraciones finales: Las representaciones sociales que los ancianos tienen respecto del VIH/SIDA influyeron negativamente a la adopción de medidas preventivas, pues el estigma está presente y el VIH/SIDA es atribuido a jóvenes y hombres que tienen sexo con otros hombres.

RESUMO Objetivo: Apreender as Representações Sociais elaboradas por idosos sobre o HIV/Aids e compreender como elas se relacionam com a prevenção da infecção pelo HIV. Método: Pesquisa descritiva e qualitativa fundamentada na Teoria das Representações Sociais, com 42 idosos atendidos na atenção primária. Os dados foram produzidos por meio de entrevistas, em profundidade, com um instrumento semiestruturado, processados no software IRaMuTeQ e analisados pela Classificação Hierárquica Descendente. Resultados: Emergiram cinco classes: "HIV/Aids: um problema de jovens"; "Melhoria da qualidade de vida de pessoas vivendo com HIV/Aids"; "Vulnerabilidade ao HIV/Aids de mulheres heterossexuais em união estável"; "Rede de informações sobre HIV/Aids: Processo de criação e transformação das Representações Sociais"; e "Prevenção versus Estigma". Considerações Finais: As representações sociais que os idosos têm sobre o HIV/Aids influenciam de forma negativa na adoção de medidas preventivas, pois o estigma está presente e o HIV/Aids é atribuído a jovens e homens que fazem sexo com homens.

Social representations of HIV/AIDS by older people and the interface with prevention.

OBJECTIVE: To apprehend the social representations elaborated by older people about HIV/AIDS and to understand how they relate to the prevention of HIV infection. METHOD: Descriptive and qualitative research based on the Theory of Social Representations with 42 older people assisted at primary care. Data were produced through in-depth interviews with a semi-structured instrument, processed in the IRaMuTeQ software, and analyzed by means of the descending hierarchical classification. RESULTS: Five classes emerged: "HIV/AIDS: a problem of young people"; "Quality of life improvement for people living with HIV/AIDS"; "Vulnerability to HIV/AIDS among heterosexual women in a stable union"; "HIV/AIDS Information Network: process of creation and transformation of social representations" and "Prevention versus stigma". FINAL CONSIDERATIONS: The social representations that older people have about HIV/AIDS influence the adoption of preventive measures negatively because stigma is present and HIV/AIDS is attributed to young men, and to men who have sex with other men.

Social incentives for adherence to tuberculosis treatment.

OBJECTIVE: To analyze the influence of social incentives for adherence to tuberculosis (TB) treatment. METHOD: Qualitative study, in which 26 primary health care professionals of São Paulo were interviewed in 2015.Their testimonies were submitted to the speech analysis technique. The theoretical reference was the social determination of the health-disease process. Ethical procedures were observed. RESULTS: TB is related to precarious living conditions. Incentives such as the basic food basket and transportation stipends are relevant for patients' adherence to treatment, as well as to the create bonds between the patient and the health team. FINAL CONSIDERATIONS: The incentives strengthened adherence to TB treatment. However, interventions in the context of public measures must transcend the remedial dimension and be guided towards the transformation of the TB situation, which means supporting processes that modify living conditions.

Assessing preference for types of social interaction.

To date, few researchers have evaluated methods for assessing preference for social interactions. Due to concerns that commonly used stimulus preference assessment methods may be inappropriate, or at least cumbersome, for the assessment of social reinforcers, we developed and evaluated a new method of assessing preference for social interactions. A social interaction preference assessment (SIPA) and a concurrent operant reinforcer assessment were conducted with five participants diagnosed with autism spectrum disorder. A differentially preferred and reinforcing social interaction was identified for all five participants. The SIPA procedures, results, and the implications of these results are discussed.